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Specification 
Title of the Invention 
Electronic Camera Apparatus 

5 Background of the Invention 

The present invention relates to an electronic 
camera apparatus and, more particularly, to an 
electronic camera apparatus for correcting the luminance 
level of a luminance signal obtained from an image 

10 sensing device having a color filter. 

Generally, many electronic camera apparatuses 
called digital still cameras employ an arrangement for 
sensing a color image using a color filter formed on one 
image sensing device. 

15 In this arrangement, an analog image signal is 

obtained from the image sensing device, in which a color 
image is represented by assigning predetermined colors 
to a number of pixels in advance, and pieces of 
luminance information with analog values representing 

2 0 the luminances of the pixels are discrete on the time 
axis . 

Normally, in sensing a color image, the 
luminance of an obtained image signal must be corrected 
in accordance with the type of light source and ambient 
25 brightness. 

In the electronic camera apparatus, a 
luminance correction amount is calculated from an image 
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signal obtained by the image sensing device in, e.g., a 
test photometry mode before image sensing, and an image 
signal obtained later by pressing the shutter button is 
corrected using the luminance correction amount. 
5 Assume a case wherein an image signal is 

converted into digital image data by an A/D converter 
and then subjected to various image processing 
operations. After the image signal is A/D-converted, 
information of details is lost by quantization. For 

10 this reason, the image quality obtained by subsequent 

image processing is largely influenced by the quality of 
original information. 

Especially, a pixel with low luminance has a 
very small amount of information and is also greatly 

15 influenced by noise and the like. Normally, before A/D 
conversion, an analog signal is directly amplified to 
minimize damage to the information amount of such pixel 
with low luminance. 

Fig. 16 shows a conventional electronic camera 

20 apparatus . 

A color image sensed by an image sensing 
device 101 in the test photometry mode is input to a 
variable gain amplification section 102 as an image 
signal 111. 

25 The image signal 111 is amplified by the gain 

controlled by a gain control section 103, converted into 
a digital signal by an A/D conversion section 104, and 
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temporarily stored in a digital memory 105 as image data. 

Image data 113 is read out from the digital 
memory 105. A luminance detection section 106 detects 
statistical luminance information such as average 
5 luminance and maximum and minimum luminance values in 
units of colors of the image data 113. 

In accordance with the detection result from 
the luminance detection section 106, a control section 
107 calculates a correction coefficient common to all 
10 colors. The gain of the variable gain amplification 
section 102 is set by the gain control section 103 on 
the basis of the correction coefficient. 

When an image signal is obtained indoors under 
an incandescent lamp, the white balance of the obtained 
15 color image is bad, and the luminance of blue (B) tends 
to extremely lower, as shown in Figs. 17A to 17D. 

For example, it should be balanced as shown in 
Fig. 17A under ideal light source, the output signal 
from the image sensing device 101 are not balanced due 
2 0 to the influence of the incandescent lamp, as shown in 
Fig. 17B. 

In this case, the control section 107 
calculates a correction coefficient that corrects with 
which the luminance of blue (B) has an appropriate value 
25 to some degree, and a corresponding gain is set by the 
gain control section 103. 

In the subsequent image sensing mode, pieces 
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of luminance information contained in the image signal 
111 from the image sensing device 101 are amplified by 
the gain based on the correction coefficient at the same 
magnification for all colors, as shown in Fig. 17C. 
5 Then, as described above, the image signal is 

converted into a digital signal by the A/D conversion 
section 104 and temporarily stored in the digital memory 
105 as new image data. 

After that, new image data 113 is read out 

10 from the digital memory 105, and the statistical 

luminance information of the new image data 113 is 
detected by the luminance detection section 106 in the 
same way as described above. 

Accordingly, the control section 107 

15 determines whether image processing is necessary and 
calculates parameters therefor. An image processing 
section 108 executes predetermined image processing for 
the new image data 113, e.g., processing of further 
amplifying the luminance of blue (B) . 

20 With this processing, image data 

color-balanced to some extent is generated, as shown in 
Fig. 17D, and stored in the digital memory 105. 

The image processing section 108 also performs, 
other processing such as color correction, contour 

25 extraction, and compression. 

However, such a conventional electronic camera 
apparatus has the following problems because the 
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variable gain amplifier provided on the output side of 
the image sensing device amplifies the image signal 
obtained from the image sensing device by the same gain 
for all colors and all pixel positions. 
5 Referring to Fig. 16, if the image signal 111 

obtained from the image sensing device 101 has extremely 
different luminances of red, green, and blue (RGB) , a 
color that originally obtains satisfactory luminance is 
saturated when amplified by the variable gain 

10 amplification section 102. The luminance distribution 
of the image shifts to the bright side, resulting in 
poor image quality. 

For example, referring to Fig. 17C, when the 
luminance of blue (B) is amplified to an appropriate 

15 value, red and green (RG) exceed the input range (0 to 
1.0) of the A/D conversion section 104. 

Hence, the luminance distribution shifts to 
the high luminance side. In addition, all the luminance 
values exceeding the input range become the highest 

2 0 luminance value (1.0), and the original luminance 

information is lost, resulting in an image with poor 
quality. 

Normally, in the optical system used to focus 
light to the image sensing device, light at corners is 
25 attenuated as compared to the central portion due to the 
Cosine Fourth Law or shading, as known as vignetting. 

However, the variable gain amplification 
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section 102 of the conventional electronic camera 
apparatus shown in Fig. 16 amplifies the entire image 
region by the same gain and therefore cannot correct 
vignetting. 

5 Such vignetting may be corrected by filter 

processing by the image processing section on the output 
side. In fact, vignetting tends not to be corrected 
because the processing takes a time and consumes power. 
Summary of the Invention 

10 The present invention has been made to solve 

the above problems, and has as its object to provide an 
electronic camera apparatus capable of obtaining an 
image with appropriate luminance balance without 
degrading the image quality. 

15 In order to achieve the above object, 

according to the present invention, there is provided an 
electronic camera apparatus for reading out, from an 
image sensing device, an image signal which represents a 
color image constructed by a number of pixels to which 

20 predetermined colors are assigned and has pieces of 

luminance information with analog values representing 
luminances of the pixels, the luminance information 
being discrete on a time axis, and generating a desired 
image from the image signal, comprising a luminance 

25 correction section for generating individual correction 
coefficients from a plurality of correction coefficients 
in units of pixels, correcting corresponding luminance 
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information in the image signal on the basis of each 
correction coefficient, and outputting a new image 
signal used for image generation. 
Brief Description of the Drawings 
5 Figs. 1A and IB are block diagrams showing an 

electronic camera apparatus according to an embodiment 
of the present invention; 

Fig. 2 is a block diagram showing the 
arrangement of a luminance correction section; 
10 Fig. 3 is a block diagram showing the 

arrangement of a luminance correction amplification 
section; 

Fig. 4 is a block diagram showing the 
arrangement of a gain control section; 
15 Figs. 5A to 5F are explanatory views showing 

processing of correcting luminance in units of colors; 

Fig. 6 is a block diagram showing the 
arrangement of a switching control section (when 
luminance is individually corrected in units of colors) ; 
20 Fig. 7 is a timing chart showing the operation 

of the gain control section; 

Figs. 8A to 8G are explanatory views showing 
an application example to luminance correction; 

Figs. 9A and 9B are explanatory views showing 
25 the arrangement of a luminance detection section; 

Figs. 10A and 10B are explanatory views 
showing vignetting by an optical system; 
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Figs. 11A and 11B are explanatory views 
showing a method of calculating a luminance correction 
coefficient for vignetting; 

Fig. 12 is a block diagram showing the 
5 arrangement of a switching control section (when 
luminance correction for vignetting is performed) ; 

Figs. 13A and 13B are explanatory views 
showing another method of calculating a luminance 
correction coefficient for vignetting; 
10 Fig. 14 is a block diagram showing the 

arrangement of a switching control section (when 
luminance is corrected in units of regions using 
individual correction coefficients); 

Figs. ISA and 15B are block diagrams showing 
15 an arrangement according to another embodiment of the 
present invention; 

Fig. 16 is a block diagram showing the 
arrangement of a conventional electronic camera 
apparatus; and 

20 Figs. 17A to 17D are explanatory views showing 

a conventional color balance correction method. 
Description of the Preferred Embodiments 

The present invention will be described next 
with reference to the accompanying drawings. 

25 Figs. 1A and IB show an electronic camera 

apparatus according to an embodiment of the present 
invention. Fig. 1A shows an arrangement in which image 
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data is stored as digital data. Fig. IB shows an 
arrangement in which image data is stored as analog data. 

Referring to Figs. 1A and IB, reference 
numeral 5 denotes an image sensing device such as a 
5 color CCD; and 10, a luminance correction section which 
amplifies an image signal 5A, obtained by the image 
sensing device 5, by an arbitrary gain in units of 
pixels to correct luminance. 

A luminance detection section 6 detects, from 

10 an image signal 5B amplified by the luminance correction 
section 10, statistical luminance information such as 
the average luminance value and maximum and minimum 
luminance values in units of colors and, additionally, 
commonly for all colors. A control section 7 calculates 

15 a luminance correction coefficient for each pixel and, 
additionally, that common to all pixels on the basis of 
the statistical luminance information detected by the 
luminance detection section 6. 

An A/D conversion section 8 converts the image 

20 signal 5B into a digital signal. A digital storage 

section 9 stores the digital image signal converted by 
the A/D conversion section 8 as image data. 

The image signal 5A obtained from the image 
sensing device 5 is generally called a color interleaved 

25 signal. This image signal represents a color image 

constructed by a number of pixels to which predetermined 
colors (e.g., red, green, and blue: RGB) are assigned in 
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advance. In this image signal, pieces of luminance 
information with analog values representing the 
luminances of the pixels are discrete on the time axis. 

A clock signal CLK is synchronized with each 
5 luminance value in the image signal 5A. 

An image processing section using, e.g., a DSP 
may be connected to the output side of the digital 
storage section 9 or an analog storage section 9A as 
needed, as in the prior art, to perform image processing 
10 such as color correction, edge extraction, and 

compression for the image data read out from the storage 
section 9 or 9A. 

The digital storage section 9 or analog 
storage section 9A may be constructed by a detachable 
15 storage medium. 

The luminance correction section 10 will be 
described next with reference to Fig. 2. 

Fig. 2 shows the arrangement of the luminance 
correction section . 
20 Referring to Fig. 2, a luminance correction 

amplification section 1 amplifies the image signal 5A 
from the image sensing device 5 by an arbitrary gain in 
units of pixels. A gain control section 2 sets and 
controls the gain of the luminance correction 
25 amplification section 1 in synchronism with the clock 
CLK in units of pixels on the basis of a plurality of 
correction coefficients a, to a (m is an integer of 2 

1 TTl 
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or more) . 

The luminance correction amplification section 

I will be described next with reference to Fig. 3. 

Fig. 3 shows the arrangement of the luminance 
5 correction amplification section that is constructed 
using a switched capacitor circuit. 

Referring to Fig. 3, a gain switching section 

II selects the magnitudes of capacitance components 
connected in parallel to the image signal 5A in 

10 accordance with switching signals <t> n to ln and <t> n to <i> 
2n (n is an integer of 2 or more) from the gain control 
section 2, thereby switching the gain. An amplification 
section 12 amplifies and outputs the image signal 5A on 
the basis of the gain determined by the capacitance 

15 ratio of the capacitance component selected by the gain 
switching section 11 to a fixed capacitance component. 

The gain switching section 11 has a plurality 
of capacitive elements C x to C n having different 
capacitances and arranged in parallel with respect to 

2 0 the image signal 5A. 

Switches S„ to S. and S„ to S. are connected 

11 In ll iti 

to the input and output sides of the capacitive elements 
C to C . These switches are ON/OFF-controlled by the 

1 n 

switching signals 0 n to <t> ln and n to <£ 2n from the gain 
25 control section 2. 

In the amplification section 12, an 
operational amplifier 13 and inverting amplifier 14 are 
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serially connected. 

A capacitive element C Q as a fixed capacitance 
component and switch S Q are parallelly connected between 
the inverting input (-) and the output of the 
operational amplifier. 

Especially, the capacitance ratios of the 
capacitive element C Q to the capacitive elements C x to C n 
are set at 2° to 2 n ~\ respectively. Bits that represent 
desired gains by n binary digits are made to correspond 
to the capacitive elements C 1 to C n , respectively. 

The gain control section 2 will be described 
next with reference to Fig. 4. 

Fig. 4 shows the arrangement of the gain 
control section in which n switching control sections 21 
to 2n are parallelly arranged in correspondence with the 
bits that represent desired gains by n binary digits, 
e.g., the capacitive elements C x to C n of the gain 
switching section 11, which are set in the luminance 
correction amplification section 1. 

Bits a n to a ln , a n to a ^ . . . to a m 

corresponding to the correction coefficients a 1 to a ra 
are parallelly input to the switching control sections 
21 to 2n, respectively. One of these bits is selected 
by a coefficient selection section 33 on the basis of 
the clock CLK and output as a correction coefficient a Q . 

On the basis of clocks <p g and <f> l synchronized 
with the clock CLK, the switching signals & to 0 and 
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$ to <!> 2n are generated by gates 31 and 32. 

As the first embodiment of the present 
invention, a case wherein the luminance of the image 
signal 5A formed from an RGB color interleaved signal is 
5 corrected in units of colors, i.e., red, green, and blue 
(RGB) using individual correction coefficients a , a , 
and a will be described next with reference to the 

B 

accompanying drawings. 

Figs. 5A to 5F show processing of correcting 
10 luminance in units of colors. 

Assume that although the object color 
temperatures of all of red, green, and blue (RGB) are 
balanced, as shown in Fig. 5A, the image sensing device 
color sensitivities of the image sensing device 5 are 
15 not balanced due to the influence of an incandescent 
lamp, as shown in Fig. 5B. 

In this case, to obtain white balance as shown 
in Fig. 5C, luminance need be corrected in units of 
colors using individual correction coefficients, as 
20 shown in Fig. 5D. 

In actual image sensing, images are 
continuously received from the image sensing device 5, 
as in a general electronic camera. 

The gain of the luminance correction section 
25 10 is set at an appropriate value (e.g., IX), and an 

image is obtained. When the shutter button is pressed, 
the correction coefficients are calculated by the 
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control section 7 on the basis of statistical luminance 
information detected by the luminance detection section 
6 from the image signal of a preceding (e.g., 
immediately preceding) image. 
5 When the image signal 5A is expressed as a 

two-dimensional plane, i.e., a color frame, a 
checkerboard pattern of RGB is normally formed, as shown 
in Fig. 5E. 

Hence, the individual correction coefficients 
10 for the respective colors need be ON/OFF-controlled in 
accordance with the color layout, as shown in Fig. 5F. 

Fig. 6 shows the arrangement of the switching 
control section applied when luminance is individually 
corrected in units of colors. Especially, Fig. 6 shows 
15 an arrangement corresponding to the ith (i is 1 to n) 
bit. 

Referring to Fig. 6, the coefficient selection 
section 33 has a switching section (MUX) 34A for 
selectively outputting a red correction coefficient a 
20 and blue correction coefficient as . on the basis of a 

Bl 

signal Line representing switching between pixel lines 
"GRGR. . and "BGBG . 

The coefficient selection section 33 also has 
a switching section (MUX) 34B for selectively outputting 
25 the output from the switching section 34A and a green 

correction coefficient a r . on the basis of the clock CLK 

bl 

synchronized with each pixel. 
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The coefficient selection section 33 
selectively outputs a color correction coefficient a R , 
corresponding to each pixel position represented by the 
clock CLK, as shown in Fig. 5F. 
5 On the basis of the clocks <£ 0 and <t> lf the 

switching signals <P n and <t> n are generated by the gates 
31 and 32. 

A flip-flop (FF) 35 is provided to hold the 
clock CLK for only a period corresponding to one pixel 
10 and output the clock. 

The signal Line can be generated by counting 
the clocks CLK corresponding to the number of pixels of 
one line. 

As shown in the timing chart of Fig. 7, the 
15 switching control section 2i of the ith bit selects the 
red correction coefficient a R . (in this case, "1") in 
the R section of a red pixel, and the entire gain 
control section 2 outputs a correction coefficient a R as 
the correction coefficient a^. 
20 The gain switching section 11 of the luminance 

correction amplification section 1 turns on/off the 
switches S„ to S, and S 01 to S. in accordance with the 

11 In Li 

switching signals <t> n to 0 ln and <t> 21 to 0 2n representing 
the correction coefficient a R . 
25 Of the capacitive elements C L to C n , only 

capacitive elements whose switches S u to S ln are turned 
on are charged in correspondence with the amplification 
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voltage of the image signal 5A, i.e., the pixel level of 
red pixels corresponding to the R section. 

After that, only charges in the capacitive 
elements whose switches S to S 2n are ON are applied to 
5 the amplification section 12. As a result, the signal 
is amplified by the capacitance ratio of the capacitive 
elements whose switches S ni to S„ are ON to the capacitive 

21 2n ^ 

element C Q and output. 

In this way, the correction coefficients a , 

10 a Gi , anda Bi corresponding to RGB colors are selected by 
the gain control section 2 in the R, G, and B sections 
corresponding to the pixels. In accordance with the 
correction coefficient, the image signal 5A is amplified 
by the luminance correction amplification section 1 in 

15 units of colors using individual gains, so the image 
signal 5B with corrected white balance is obtained. 

Hence, unlike the prior art in which the image 
signal is amplified using a gain common to all colors, 
the image signal can be amplified in units of colors 

20 using appropriate gains without saturating a color with 
satisfactory luminance, and an image with appropriate 
luminance can be obtained without degrading the image 
quality. 

In addition, since the luminance of an analog 
25 image signal is corrected, the signal can be processed 
at a high speed with a small circuit scale, and power 
consumption can also be reduced, as compared to a case 
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wherein data processing done in digital domain by an 
image processing section. 

As an expansion example of such light source 
correction, the scene of an image may be estimated using 
5 various types of statistical luminance information, and 
the image signal may be corrected in units of colors 
using correction coefficients optimum to the scene. 

For example if it is determined a scene at the 
sunset, the correlation coefficients of the respective 
10 colors are set not to reduce reddishness too much, 
thereby adjusting white balance without losing the 
feature of the scene. 

An example of light source correction has been 
described above. However, the present invention is not 
15 limited to this. 

Figs. 8A to 8G show an application example of 
luminance correction . 

For example, as shown in Fig. 8A, when the 
color temperature of an object originally has a 
20 variation, the present invention can be applied as 

dynamic range correction for correcting the variation in 
color temperature . 

More specifically, when the image signal 5A 
with characteristics shown in Fig. 8B is obtained from 
25 the image sensing device 5, correction coefficients of 
the respective colors are calculated and set such that 
the range can be effectively used by the changes in 
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luminance of the colors, thereby obtaining the image 
signal 5B with satisfactory luminance balance as shown 
in Fig. 8C. 

As shown in Fig. 8D, when the image sensing 
5 device 5 itself has a variation in sensitivity although 
the object itself has no variation in color temperature, 
the present invention can be applied as sensitivity 
correction for correcting the variation in sensitivity. 

More specifically, when the image signal 5A 
10 with characteristics shown in Fig. 8E is obtained from 
the image sensing device 5, correction coefficients are 
calculated and set such that the luminance level of a 
color with low sensitivity is largely amplified, thereby 
obtaining the image signal 5B with satisfactory 
15 luminance balance as shown in Fig. 8F. 

As is apparent from the above description, it 
can be expressed that the luminance correction section 
10 of the present invention performs processing as shown 
in Fig. 8G. 

20 More specifically, a correction coefficient a 

in units of pixels contained in the image signal 5A is 
represented by the sum of products of correction 
coefficients a R a G , and a B corresponding to the 
respective colors and switch coefficients SR, SG, and SB 
25 which are "1" only when colors corresponding to the 

pixels are red, green, and blue (RGB), and "0" otherwise. 

In the above description, as shown in Figs. 1A 
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and IB, the luminance detection section 6 for detecting, 
from the analog image signal 5B output from the 
luminance correction section 10, statistical luminance 
information such as the average luminance value and 
5 maximum and minimum luminance values in units of colors 
and, additionally, commonly for all colors is provided 
and, on the basis of the statistical luminance 
information obtained by the luminance detection section 
6, the control section 7 calculates the correction 

10 coefficient a to be input to the gain control section 2. 

Figs. 9A and 9B show the arrangement of the 
luminance detection section. Fig. 9A shows a circuit 
for detecting the average luminance value of only pixels 
of a predetermined color, and Fig. 9B shows an operation 

15 example. 

The luminance detection section comprises a 
luminance adder 61 for adding pixel values (voltage 
values) of a predetermined color using a switched 
capacitor and outputting the result, a comparator 62 for 

2 0 comparing a sum output 6A from the luminance adder 61 

with a threshold value V TH , and a counter 63 for counting 
a comparison output 6B from the comparator 62 and 
outputting a counter output 6C to the control section 7 
as an average luminance value. 

25 Switches S61 and S62 of the luminance adder 61 

are alternately turned on without any overlapping in a 
period corresponding to pixels of a predetermined color 
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of the image signal 5B, thereby storing, in a capacitive 
element C60, charges stored in a capacitive element C61. 

With this operation, the sum output 6A 
gradually increases , as shown in Fig. 9B. When it has 
5 reached the threshold value V TR , the comparison output 6B 
from the comparator 62 is inverted. This comparison 
output 6B is counted by the counter 63 and output as the 
counter output 6C. 

In this case, the ratio of an increase in the 

10 sum output 6A to the threshold value V r{J (a change in the 
counter output 6C) , i.e., the resolution is determined 
by a capacitance ratio STEP of the capacitive element 
C60 to the capacitive element C61. 

Since statistical luminance information is 

15 directly detected from the analog image signal, the 
statistical luminance information of desired color 
pixels or all pixels can be accurately detected at a 
high speed without using any A/D converter. 

In the above description, the correction 

20 coefficient a of the gain control section 2 is 

calculated and set by the control section 7 in units of 
image signals 5A obtained by the image sensing device 5. 
However, for fixed luminance correction in the apparatus, 
a fixed correction coefficient may be used. 

25 For example, a correction coefficient used for 

sensitivity correction of the image sensing device 5 or 
sensitivity correction for vignetting by an optical 
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system (to be described later) may be obtained by 
measurement in advance and registered in, e.g., a ROM. 

The second embodiment of the present invention 
in which the present invention is applied to light 
5 attenuation correction for vignetting of an optical 
system will be described next with reference to the 
accompanying drawings . 

Figs. 10A and 10B show vignetting by the 
optical system. Fig. 10A shows an example of 
10 characteristics of vignetting, and Fig. 10B shows a 
calculation example of a correction coefficient. 

In the optical system arranged on the input 
side of an image sensing device 5, vignetting as shown 
in Fig. 10A occurs due to the Cosine Fourth Law or 
15 shading. 

Generally, when the angle that is made by a 
center O of an image obtained by the image sensing 
device and a point P apart from the center 0 and viewed 
from a point R apart from the center O in the vertical 
20 direction by a distance D is 8 r the light attenuation 
amount at the point P is represented by COS 0 , and the 
value k normally has a numerical value within the range 
of 1 to 4. 

Correction coefficients for such a light 
25 attenuation amount cannot be prepared for all pixels. 

In the present invention, as shown in 
Figs. 11A and 11B, the correction coefficient of each 
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pixel is decomposed in the two-dimensional X and Y 
directions and stored in advance, and calculated in 
accordance with the coordinate positions of each pixel. 

Figs. 11A and 11B show a method of calculating 
5 a luminance correction coefficient for vignetting. 

First, as shown in Fig. 11A, correction 
coefficients a m) to a projected to the X-axis side 
and correction coefficients a vm to as projected to the 

Y(l) Y(n) ^ - J 

Y-axis side are obtained in units of pixel positions (x 
10 = 1 to w, y = 1 to h) on an image and registered in, 
e.g., a ROM as a correction coefficient table. 

A correction coefficient a ^ at pixel 

P(x,y) ^ 

positions x and y is obtained from the product of 
correction coefficients in the two axial directions. 
15 In this case, as shown in Fig. 11B, since the 

correction coefficients a x(x) and a are approximately 1. 
For this reason, the correction coefficient a 

P(x,y) 

represented by the product of the two correction 
coefficients can be calculated from the sum of the 
20 correction coefficients without any large error. Hence, 
the correction coefficient can be calculated at a high 
speed with a simple circuit arrangement, as compared to 
a method of calculating the product of two correction 
coefficients . 

25 Fig. 12 shows the arrangement of a switching 

control section applied when luminance correction for 
vignetting is performed. Especially, Fig. 12 shows an 
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arrangement corresponding to the ith (i is 1 to n) bit. 

Referring to Fig. 12, a coefficient selection 
section 33 has a counter (CNT) 38X for calculating the 
x-coordinate value x of each pixel on the basis of a 
5 clock CLK synchronized with each pixel, and a counter 
(CNT) 38Y for calculating the y-coordinate value y of 
each pixel on the basis of a signal Line representing 
switching of pixel lines. 

The corresponding correction coefficient a x(x) 
10 is selected from the correction coefficients a x(1J to a x{w) 
by a switching section (MUX) 37X on the basis of the 
coordinate value x and the corresponding correction 
coefficient a y{y) is selected from the correction 
coefficients a to a y(h) by a switching section (MUX) 
15 37Y on the basis of the coordinate value y. These 
correction coefficients are added by an adder 39. 

The correction coefficient as . . corresponding 
to the coordinate positions of each pixel is calculated. 
On the basis of clocks 0 0 and <f> x , switching signals 0 u 
20 and 0 2 .are generated by gates 31 and 32, respectively. 

Hence, switching signals 0 n to 0 ln and 0 n to 
0 2n corresponding to the correction coefficient a p(x#y) for 
correcting vignetting are output to a luminance 
correction amplification section 1 in units of pixel 
25 positions x and y. An image signal 5A is amplified 

using individual gains in units of pixel positions, and 
an image signal 5B with corrected vignetting is obtained. 
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With this arrangement, the image signal can be 
amplified by appropriate gains in units of pixel 
positions, and an image with appropriate luminance can 
be obtained without degrading the image quality. 

In addition, since luminance of an analog 
image signal is corrected, the signal can be processed 
at a high speed with a small circuit scale, and power 
consumption can also be reduced, as compared to a case 
wherein data processing done in digital domain by an 
image processing section. 

In the above description, the correction 
coefficients a x(1) to a x(w) and a Y(1J to a y(hJ individually 
obtained in advance in units of pixel positions x and y 
are used. However, correction coefficients obtained in 
advance in units of predetermined pixel ranges may be 
used. 

Figs. 13A and 13B show another method of 
calculating a luminance correction coefficient for 
vignetting. 

First, as shown in Fig. 13A, correction 
coefficients a m to a x(tflJ projected to the X-axis side 
and correction coefficients a y(1) to a y(hl) projected to the 
Y-axis side are obtained in units of pixel ranges (x 1 = 
1 to w', y T = 1 to h 1 ) on an image and registered in, 
e.g., a ROM as a correction coefficient table. 

The desired pixel positions x and y are 
converted into pixel ranges x T and y 1 . A correction 



coefficient a p(x , , } in the pixel ranges x 1 and y 1 is 
obtained from the product of correction coefficients in 
the two axial directions, as the correction coefficient 
a , at the pixel positions x and y. 

In this case as well, as described above, as 
shown in Fig. 13B, since the correction coefficients a 
and a are approximately 1. For this reason, the 

X(x') Y(y') L L 

correction coefficient a_, vl .. represented by the product 
of the two correction coefficients can be calculated 
from the sum of the correction coefficients without any 
large error. 

As described above, since the correction 
coefficients on the X- and Y-axis sides are used in 
units of pixel ranges on the image, the storage capacity 
necessary for storing correction coefficients can be 
decreased. 

The switching control section in the gain 
control section 2 for realizing this operation is the 
same as that shown in Fig. 12. Especially, of the 
outputs from the counters 38X and 38Y, only the upper 
bits need be used to control the switching sections 37X 
and 37Y. 

In the second embodiment, as an example of 
luminance correction for vignetting by the optical 
system, luminance correction for vignetting having the 
distribution COS k 0 from the frame center has been 
described. However, the present invention is not 



limited to this. 

For example, when an optical system including 
a prism or the like is used, light attenuation, i.e., 
degradation in sensitivity has another distribution 
characteristic . 

A different sensitivity degradation 
distribution may occur due to a factor other than the 
optical system. 

However, when the light attenuation 
distribution or sensitivity degradation distribution can 
be represented by arithmetic expressions shown in 
Fig. 11B or 13B, the present invention can be applied, 
and the same effect as described above can be obtained. 

As a method of performing luminance correction 
for another light attenuation distribution or 
sensitivity degradation distribution in units of regions, 
the average luminance of each color (RGB) of individual 
regions of an image may be regarded as a sensitivity 
degradation distribution, and on the basis of the 
distribution, individual correction coefficients may be 
set in units of regions and used for luminance 
correction . 

For example, for an image obtained from the 
image sensing device in advance, the average luminance 
of each color is detected in units of regions. 

A region whose luminance Y exhibits the 
largest value is assumed as a white region. 



Y = 0.3R + 0.59G + 0.11B 

Luminances of the remaining regions are 
corrected in a similar way using correction coefficients 
for correcting the average luminance of each color 
actually obtained in the white region to white. 

The luminance is corrected in all regions such 
that the region with the largest average luminance value 
becomes the white region, so appropriate white balance 
can be relatively easily obtained. 

Instead of correcting luminances of the 
remaining regions with reference to the white region, 
luminance of each region may be corrected using an 
appropriate reference . 

For example, in the average luminance of all 
colors (RGB) in an arbitrary region, a greater part of 
luminance distribution is shifted to the upper or lower 
side of a desired range (e.g., the input range of the 
A/D conversion section) used in subsequent processing, 
individual correction coefficients with which a greater 
part of luminance distribution falls within the range 
are used to correct luminance of the region. 

As an arrangement for correcting luminance of 
an image signal on the basis of correction coefficients 
individually set in units of regions, a switching 
control section 2i as shown in Fig. 14 can be used. 

Fig. 14 shows the arrangement of the switching 
control section applied when luminance is corrected in 



units of regions using individual correction 
coefficients. Especially, Fig. 14 shows an arrangement 
corresponding to the ith (i is 1 to n) bit. 

Referring to Fig. 14, the coefficient 
5 selection section 33 has a counter (CNT) 38X' for 

counting the X-coordinate value of each pixel on the 
basis of the clock CLK synchronized with each pixel and 
outputting an X-coordinate value x' of each region, and 
a counter (CNT) 38Y ! for calculating the Y-coordinate 

10 value of each pixel and outputting the Y-coordinate 

value y' on the basis of the signal Line representing 
switching of pixel lines . 

A corresponding correction coefficient a a(x , , } 
is selected from individual correction coefficients a A{11) 

15 to ol , u x by the switching section (MUX) 37X on the basis 

A (ah, aw) J ^ 

of the coordinate values x ! and y 1 in units of regions. 
On the basis of the clocks <t> ^ and <t> ^, the switching 
signals 0 and <£> 2 .are generated by the gates 31 and 32, 
respectively. 

20 Hence, switching signals <f> to <j> and <t> to 

0 2n corresponding to the correction coefficient a A(x , 
for individually correcting luminance of each region are 
output to the luminance correction amplification section 
1. The image signal 5A is amplified by a corresponding 

25 gain, and the image signal 5B corrected by individual 

correction coefficient in units of regions is obtained. 
In this case, the reference of average 
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luminance corresponding to a desired range used in 
subsequent processing, i.e., reference average luminance 
may be set, and correction coefficients corresponding to 
the regions may be calculated such that the average 
5 luminance of each region falls within the range between 
the maximum and minimum values of the reference average 
luminance . 

Alternatively, conversion characteristics for 
performing the same calculation processing as described 
10 above may be stored as a table. The average luminance 
of each region may be input to read out an optimum 
correction coefficient from the table. 

As described above, since luminance is 
corrected in units of regions using individual 
15 correction coefficients, the desired range, i.e., the 

dynamic range of the electronic camera apparatus can be 
effectively used in units of regions, and a high-quality 
image can be obtained. 

Even for a region such as shade in a fine day, 
20 which has luminance much lower than that of other 

regions, details can be reproduced without any influence 
on the luminance distribution of other regions. 

In setting individual correction coefficients 
in units of regions, the maximum correction width may be 
25 suppressed within a range to some degree. 

In this case, a prominent value is not set 
only for the correction coefficient in an arbitrary 
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region, the sense of incompatibility due to the 
luminance difference at the boundary between the region 
and adjacent regions in the periphery is reduced, and an 
image signal with a higher quality can be generated. 
5 In the above example, luminance is corrected 

on the basis of the average luminance of all colors 
(RGB) obtained in units of regions. This method may be 
combined with the above-described first embodiment to 
individually detect the average luminance of each color 
10 in units of regions and correct the luminance in units 
of colors in each region on the basis of the average 
luminance . 

With this arrangement, the desired range, i.e., 
the dynamic range of the electronic camera apparatus can 

15 be effectively used in units of colors in each region, 
and a high-quality image can be obtained. 

The luminance correction section 10 of the 
present invention can be located at any position as far 
as it is located between the image sensing device 5 and 

20 an A/D conversion section 8 or between the image sensing 
device 5 and an analog storage section 9A. 

When a correlated double sampling (CDS) 
circuit is connected to the output side of the image 
sensing device 5 to remove reset noise generated in the 

25 CCD charge detection section or 1/f noise generated in 
the CCD output stage, the luminance correction section 
10 of the present invention may be constructed using the 
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operational amplifier in the CDS circuit. 

In the above description, the present 
invention is individually applied as the first or second 
embodiment. However, the two embodiments may be 
simultaneously applied. 

Figs. ISA and 15B show the arrangement of the 
third embodiment of the present invention. Fig. ISA 
shows a case wherein luminance correction is performed 
serially, and Fig. 15B shows a case wherein luminance 
correction is performed at once. 

Referring to Fig. ISA, a luminance correction 
section 10A corrects luminance of an image signal 5A 
from an image sensing device using individual correction 
coefficients a. a. and a D in units of color pixels. A 

R G B 

luminance correction section 10B individually corrects 
luminance of an image signal 5C from the luminance 
correction section 10A in units of pixel positions using 
correction coefficients a to a x(wJ projected to the 
X-axis side and correction coefficients a y{1) to a y(h) 
projected to the Y-axis side and outputs an image signal 
5B. 

In this case, the luminance correction section 
10B corresponding to the second embodiment is connected 
in series with the luminance correction section 10A 
corresponding to the first embodiment. 

The arrangement of a luminance correction 
amplification section 1A and luminance correction 



amplification section IB is the same as that of the 
luminance correction amplification section 1 described 
with reference to Fig. 3. 

As a gain control section 2A, the switching 
control section 2i described with reference to Fig. 6 is 
used. As a gain control section 2B, the switching 
control section 2i described with reference to Fig. 12 
is used. 

Referring to Fig. 15B, two gain switching 
sections 11A and 11B are parallelly arranged in a 
luminance correction amplification section 1C. The 
above-described gain control sections 2A and 2B are 
provided in correspondence with the two gain switching 
sections 11A and 11B, respectively. 

The gain switching sections 11A and 11B have 
the same arrangement as that of the above-described gain 
switching section 11 shown in Fig. 3. 

In this case, capacitive elements of the gain 
switching sections 11A and 11B are selected on the basis 
of correction coefficients selected by the gain control 
sections 2A and 2B. Charges stored in the selected 
capacitive elements are added and transferred to the 
capacitive element of an amplification section 12. 

As a consequence, the image signal 5A is 
amplified by a gain corresponding to the product of the 
two correction coefficients selected by the gain control 
sections 2A and 2B. 
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When different luminances are serially 
corrected, as shown in Fig. 15A, luminance correction is 
individually performed. Even when one correction amount 
(gain) is relatively smaller than the other correction 
5 amount (gain) , accurate luminance correction can be 
performed. 

When luminance correction is performed at once, 
as shown in Fig. 15B, the circuit arrangement is 
simplified. 

*3 10 As has been described above, according to the 

H present invention, individual correction coefficients 

are generated from a plurality of correction 
CO coefficients in units of pixels, and each luminance 

g information corresponding to the pixel in the image 

i'il; 15 signal is corrected on the basis of the correction 

JSJ coefficient. 

Since a new image signal in which luminance 
information arranged in units of pixels are individually 
corrected is generated, an image with appropriate 
20 luminance balance can be obtained without degrading the 
image quality, unlike the prior art in which luminances 
of pixels are corrected using one correction coefficient. 

For example, when, using correction 
coefficients in units of pixel colors, luminances are 
25 corrected in units of pixels using correction 

coefficients of colors assigned to the pixels, light 
source correction or white balance correction optimum to 
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the image can be performed. 

In addition, when, using correction 
coefficients in units of coordinate positions, 
luminances are corrected in units of pixels using 
correction coefficients corresponding to the pixel 
positions, vignetting by the optical system can be 
corrected without degrading the image quality. 



What is claimed is: 



1. An electronic camera apparatus for reading out, 

2 from an image sensing device , an image signal which 

3 represents a color image constructed by a number of 

4 pixels to which predetermined colors are assigned and 

5 has pieces of luminance information with analog values 

6 representing luminances of the pixels, the luminance 

7 information being discrete on a time axis, and 

8 generating a desired image from the image signal, 

9 comprising: 

10 a luminance correction section for generating 

11 individual correction coefficients from a plurality of 

12 correction coefficients in units of pixels, correcting 

13 corresponding luminance information in the image signal 

14 on the basis of each correction coefficient, and 

15 outputting a new image signal used for image generation. 

2. An apparatus according to claim 1, further 

2 comprising a luminance correction section connected in 

3 series with the image signal. 

3. An apparatus according to claim 1, wherein 

2 said luminance correction section comprises 

3 a correction control section for sequentially 

4 generating a luminance correction amount corresponding 

5 to each pixel from the plurality of correction 
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6 coefficients on the basis of a clock signal synchronized 

7 with each luminance information in the image signal, and 

8 a luminance correction amplification section 

9 for switching a gain in accordance with the luminance 
correction amount sequentially generated by said 

11 correction control section to amplify the input image 

12 signal by a gain corresponding to each luminance 

13 correction amount in units of luminance information, and 

14 outputting the new image signal. 

4 - An apparatus according to claim 1, wherein 

2 said luminance correction section comprises 

3 a first correction control section for 

4 sequentially generating a luminance correction amount 

5 corresponding to each pixel from a plurality of first 

6 correction coefficients on the basis of a clock signal 

7 synchronized with each luminance information in the 

8 image signal, 

a second correction control section for 
sequentially generating a luminance correction amount 
corresponding to each pixel from a plurality of second 
correction coefficients on the basis of a clock signal 

13 synchronized with each luminance information in the 

14 image signal, and 

15 a luminance correction amplification section 

16 for setting a synthesized gain as a product of a first 

17 gain corresponding to the luminance correction amount 



9 
10 
11 
12 
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18 sequentially generated by said first correction control 

19 section and the luminance correction amount sequentially 

20 generated by said second correction control section to 

21 amplify the input image signal by the synthesized gain 

22 corresponding to each luminance correction amount in 

23 units of luminance information, and outputting the new 

24 image signal. 

5. An apparatus according to claim 1, wherein the 

2 plurality of correction coefficients are formed from 

3 luminance correction amounts in units of predetermined 

4 colors assigned to the pixels, and 

5 said luminance correction section sequentially 

6 selects and uses the luminance correction amounts 

7 corresponding to the colors assigned to the pixels as 

8 the individual correction coefficients in units of 

9 pixels. 

6. An apparatus according to claim 1, wherein the 

2 plurality of correction coefficients are formed from 

3 luminance correction amounts corresponding to coordinate 

4 positions defined by two-dimensional coordinates on the 

5 color image, and 

6 said luminance correction section sequentially 

7 selects and uses the luminance correction amounts 

8 corresponding to the coordinate positions of the pixels 

9 as the individual correction coefficients in units of 
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pixels . 



7. An apparatus according to claim 1, wherein the 

2 plurality of correction coefficients are formed from 

3 luminance correction amounts corresponding to coordinate 

4 regions defined by two-dimensional coordinates on the 

5 color image, and 

6 said luminance correction section sequentially 

7 selects and uses the luminance correction amounts 

8 corresponding to the coordinate regions to which the 

9 pixels belong as the individual correction coefficients 
10 in units of pixels. 

8. An apparatus according to claim 1, wherein the 

2 plurality of correction coefficients are formed from 

3 axial luminance correction amounts representing two 

4 correction distribution characteristics changing in 

5 axial directions of two coordinate axes that form 

6 two-dimensional coordinates set on the color image, and 

7 said luminance correction section refers to 

8 corresponding axial luminance correction amounts in 

9 units of coordinate axes on the basis of coordinate 

10 positions of the pixels and sequentially generates the 

11 luminance correction amounts corresponding to the pixels 

12 from two obtained axial luminance correction values. 

9. An apparatus according to claim 1, wherein the 
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2 plurality of correction coefficients are formed from 

3 axial luminance correction amounts representing two 

4 correction distribution characteristics changing in 

5 axial directions of two coordinate axes that form 

6 two-dimensional coordinates set on the color image, and 

7 said luminance correction section refers to 

8 corresponding axial luminance correction amounts in 

9 units of coordinate axes on the basis of coordinate 

10 positions of the pixels and sequentially generates and 

11 uses products of two obtained axial luminance correction 

12 values as the luminance correction amounts corresponding 

13 to the pixels. 

10 • An apparatus according to claim 1, wherein the 

2 plurality of correction coefficients are formed from 

3 axial luminance correction amounts representing two 

4 correction distribution characteristics changing in 

5 axial directions of two coordinate axes that form 

6 two-dimensional coordinates set on the color image, and 

7 said luminance correction section refers to 

8 corresponding axial luminance correction amounts in 

9 units of coordinate axes on the basis of coordinate 

10 positions of the pixels and sequentially generates and 

11 uses sums of two obtained axial luminance correction 

12 values as the luminance correction amounts corresponding 

13 to the pixels. 
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Abstract of the Disclosure 



An electronic camera apparatus reads out, from 
an image sensing device, an image signal which 
represents a color image constructed by a number of 
pixels to which predetermined colors are assigned and 
has pieces of luminance information with analog values 
representing luminances of the pixels, the luminance 
information being discrete on a time axis, and generates 
a desired image from the image signal. The apparatus 
has a luminance correction section. 
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As a below named inventor, I declare that: 

My residence, post office address and citizenship are as stated below next to my name; I believe I am the original, first and sole 
inventor (if only one name is listed below) or an original, first and joint inventor (if plural inventors are named below) of the subject 
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as Application No. 
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37, Code of Federal Regulations, Section 1.56. I claim foreign priority benefits under Title 35, United States Code, Section 119 of any 
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Uji, Kyoto 


State/Country: 

Japan 


Postal Code: 

611-0021 
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Kitagawa 
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Citizenship: 
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